AUHR-TP-1995-0026 


THE  OPTIMALITY  OF  SEQUENTIAL  PERSONNEL 
ASSIGNMENTS  USING  A  DECISION  INDEX 


A 

R 

M 

S 

T 

R 

O 

N 

G 


Jeffrey  H.  Grobman,  Capt,  USAF 
William  E.  Alley 
Raymond  S.  Pettit,  A1C,  USAF 


19960130  026 


L 

A 

B 

O 

R 

A 

T 

O 

R 

Y 


HUMAN  RESOURCES  DIRECTORATE 
MANPOWER  AND  PERSONNEL  RESEARCH  DIVISION 
7909  Lindbergh  Drive 
Brooks  AFB,  Texas  78235-5352 


Interim  Technical  Paper  for  Period  July  1993  -  July  1994 


Approved  for  public  release;  distribution  is  unlimited. 


AIR  FORCE  MATERIEL  COMMAND 
BROOKS  AIR  FORCE  BASE,  TEXAS 


lync  QOAJ-iiTV'  aTSPEcrED  i 


NOTICES 


When  Government  drawings,  specifications,  or  other  data  are  used  for  any  purpose  other 
than  in  connection  with  a  definitely  Government-related  procurement,  the  United  States 
Government  incurs  no  responsibility  or  any  obligation  whatsoever.  The  fact  that  the  Government 
may  have  formulated  or  in  any  way  supplied  the  said  drawings,  specifications,  or  other  data,  is  not 
to  be  regarded  by  implication  or  in  any  manner  construed,  as  licensing  the  holder,  or  any  other 
person  or  corporation:  or  as  conveying  any  rights  in  any  way  to  be  related  thereto. 

The  Office  of  Public  Affairs  has  reviewed  this  paper  and  it  is  releasable  to  the  National 
Technical  Information  Service,  where  it  will  be  available  to  the  general  public,  including  foreign 
nations. 


This  paper  has  been  reviewed  and 


^ - 

JEFFREY  H.  GROBMAN,  Capt,  USAF 

Project  Scientist 


Technical  Director 

Manpower  and  Personnel  Research  Division 


Chief,  Manpower  and  Personnel  Research  Division 


REPORT  DOCUMENTATION  PAGE 

Form  Approved 

OMB  No.  0704-0188 

Public  reporting  burden  for  this  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering 
and  maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of 
information,  including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports.  1215  Jefferson  Davis  Highway,  Suite 
1204,  Arlington,  VA  22202-4302,  and  to  the  Office  of  Management  and  Budget,  Paperwork  Reduction  Project  (0704-0188),  Washington,  DC  20503. 

1.  AGENCY  USE  ONLY  (Leave  blank) 

2.  REPORT  DATE 

September  1995 

3.  REPORT  TYPE  AND  DATES  COVERED 

Interim  Technical  Paper  -  July  1993  -  July  1994 

4.  TITLE  AND  SUBTITLE 

5.  FUNDING  NUMBERS 

Optimality  of  Sequential  Personnel  Assignments  Using  a  Decision  Index 

PE  - 62205F 

PR  -  7719 

6.  AUTHOR(S) 

TA-20 

WU-24 

Jeffrey  H.  Grobman  William  E.  Alley 

Raymond  S.  Pettit 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 

Armstrong  Laboratory 

Human  Resources  Directorate 

Manpower  and  Personnel  Research  Division 

7909  Lindbergh  Drive 

Brooks  AFB,TX  78235-5352 

AL/HR-TP- 1995-0026 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

10.  SPONSORING/MONITORING 
AGENCY  REPORT  NUMBER 

11.  SUPPLEMENTARY  NOTES 

12a.  DISTRIBUTION/AVAIUBILITY  STATEMENT 

12b.  DISTRIBUTION  CODE 

Approved  for  public  release;  distribution  is  unlimited 

13.  ABSTRACT  (Maximum  200  words) 


The  purpose  of  this  study  was  to  investigate  the  optimality  of  the  decision-index  (DI)  as  it  might  be  used  for  personnel 
assigninpTit  in  a  sequential  or  "first  come-first  served"  manner.  Monte  Carlo  methods  were  implemented  to  generate  sets  of 
person-job  payoff  matrices  representing  the  utilities  or  payoffs  achievable  from  the  prospective  assignment  of  in^viduals  to 
specific  jobs.  These  matrices  were  generated  with  various  properties  including  vaiying  batch  sizes,  personnel  rejection  rates, 
person-to-job  ratios,  and  personnel  payoff  distributions.  Simulated  sequential  "assignments"  were  made  from  these  matrices 
using  "highest  payoff'  and  decision-index  strategies.  The  "highest  payoff'  method  assigned  individuals  to  jobs  so  that  the 
potential  "payoff'  for  each  in^vidual  was  maximized.  This  approach  contrasts  with  the  decision-index  method  that 
transformed  individual  payoff  scores,  prior  to  persoimel  assignment,  in  order  to  increase  the  overMl  optimality  of 
assigmnents.  Additionally,  linear  programming  techniques  established  optimal  and  minimal  assignment  solutions. 
Comparisons  of  the  results  from  each  of  these  methods  demonstrated  that  sequential  assignments  with  a  decision  index  could 
attain  approximately  92%  of  the  utility  of  an  optimal  system  for  all  conditions.  Furthermore,  use  of  a  "highest  payoff' 
decision  rule  produced  results  nearly  equivalent  to  those  from  Dl-based  sequential  assignments  when  payoff  matrix  row  and 
column  means  were  roughly  equal.  These  results  quantify  the  losses  in  overall  utility  that  result  from  using  Dl-based 
sequential  methods  to  assign  personnel  to  jobs. 


14.  SUBJECT  TERMS 

Decision  Index  Personnel  Assigpient 

Sequential  Assignment  Persoimel  Classification 

Person-job-match 

15.  NUMBER  OF  PAGES 

22 

16.  PRICE  CODE 

17.  SECURITY  CLASSIFICATION 
OF  REPORT 

Unclassified 

18.  SECURITY  CLASSIFICATION 
OF  THIS  PAGE 

Unclassified 

19.  SECURITY  CLASSIFICATION 
OF  ABSTRACT 

Unclassified 

20.  LIMITATION  OF 
ABSTRACT 

UL 

NSN  7540-01-280-5500 


standard  Form  298  (Rev  2-89)  Prescribed  by  ANSI  Std  Z-39-1 8 
298-102  COMPUTER  GENERATED 


TABLE  OF  CONTENTS 


Introduction . 

Background . 

The  Personnel  Assignment  Problem . 

Linear  Programming  Approach . 

Development  of  the  Decision  Index . 

Example  Application  of  the  Decision  Index 

Decision  Index  Implementation . 

Statement  of  the  Problem . 

Method . 


Generation  of  Payoff  Matrices . 7 

Linear  Programming  Solution  of  Assignment  Problem . 7 

Comparison  of  Methods  Using  Range  of  Value  Metric  (p) . 8 

Benchmarking  Method  With  Prior  Work . 9 

Experimental  Conditions . 9 

Results . 10 

Benchmark  of  Methods . 10 

Batch  Size  Results . 10 

Person- Job-Ratio  Results . 11 

Personnel  Rejection  Results . 13 

Payoff  Distribution  Results . 14 

Conclusion . 16 


LIST  OF  FIGURES 


Fi£ure 

1  Example  formulation  of  transportation  problem  to  solve  the  personnel  assignment 


problem . 3 

2  Benchmark  with  Brogden’ s  results  for  changing  numbers  of  jobs . 10 

3  Benchmark  with  Brogden’s  results  for  changing  rejection  rates . 10 

4  Effect  of  varying  batch  size  on  average  payoff  per  person . .  1 1 

5  Effect  of  varying  the  number  of  available  personnel  on  average  payoff  per  person 
. 12 

6  Effect  of  varying  the  number  of  available  jobs  on  average  payoff  per  person . 13 

7  Effect  of  varying  batch  size  on  average  payoff  per  person . 14 

8  Effect  of  varying  payoff  variation  on  average  payoff  per  person . 15 

9  Effect  of  varying  the  truncation  of  the  payoff  distribution  on  average  payoff  per 

person . . 15 


iii 


PREFACE 


This  work  is  part  of  the  Manpower  and  Personnel  Research  Division’s  research  program 
to  develop  a  better  understanding  of  the  classification  efficiency  of  various  optimal  and  near- 
optimal  personnel  assignment  algorithms.  Work  was  completed  under  the  in-house  exploratory 
research  program,  Development  of  Technologies  to  Allocate  People  to  Jobs  (WU  77192024). 
The  authors  wish  to  thank  Dr.  Jacobina  Skinner  and  Mr.  Larry  Looper  for  their  technical  review 
of  this  document. 


iv 


THE  UTILITY  OF  SEQUENTIAL  PERSONNEL  ASSIGNMENTS 
USING  A  DECISION  INDEX 


INTRODUCTION 

•  Personnel  may  be  assigned  to  jobs  using  either  sequential  or  batch  processes.  Batch 

methods  involve  assigning  a  group  of  personnel  to  a  group  of  jobs  whereas  sequential  methods 
assign  personnel  to  jobs  on  a  "first  come-first  served  basis."  While  batch  processes  achieve  a 
more  optimal  match  than  sequential  methods,  the  degree  to  which  batch  processes  outperform 
sequential  methods  has  not  been  quantified.  The  primary  objective  of  this  effort  was  to  quantify 
the  optimality  of  sequential  assignments  based  on  the  Decision  Index  (Ward,  1959)  throughout 
changing  batch  sizes,  person-job  ratios,  personnel  rejection  rates,  and  personnel  payoff 
distributions. 


BACKGROUND 

The  United  States  Air  Force  recruits  over  30,000  enlisted  personnel  each  year  in  order  to 
fill  openings  in  over  180  jobs.  These  jobs  range  fi'om  jet  engine  mechanic  to  security  police  with 
each  having  its  own  unique  set  of  requirements.  The  Air  Force  must  fill  these  jobs  in  order  to 
perform  its  primary  mission  of  exploitation  of  air  power  in  warfare.  It  is  desirable  that  each  job  is 
filled  with  the  person  best  suited  for  that  job  to  produce  the  most  capable  Air  Force. 

The  Personnel  Assignment  Problem 

The  goal  when  matching  people  to  jobs  is  to  maximize  the  overall  “payoff’  that  results 
from  the  sum  of  all  person-job  matches.  The  “payofiP’  fi-om  any  person-job  match  may  be  defined 
as  the  inherent  “value,”  “utility,”  or  "worth"  associated  with  placing  an  individual  in  a  certain  job 
(Hendrix,  Ward,  Pina,  &  Haney,  1979).  Individual  payoff  values  are  calculated  by  first 
determining  various  measures  of  interest  fi'om  each  prospective  person-job  match  such  as 
predicted  technical  school  grade  or  the  probability  of  completing  a  term  of  enlistment.  Values  for 
these  measures  of  interest  are  derived  from  the  interaction  between  personnel  characteristics  and 
job  attributes.  The  measures  of  interest  are  then  combined  using  multiattribute  decision  modeling 
techniques  to  yield  one  measure  of  payoff  for  each  potential  person-job  match  (Hendrix,  Ward, 
Pina,  &  Haney,  1979). 

The  association  of  a  payoff  to  each  possible  person-job  match  creates  a  payoff  matrix 
consisting  of  the  payoffs  from  the  assignment  of  each  person  to  each  job.  The  following  example 
shows  a  payoff  matrix  for  3  people  and  3  jobs. 


Jobl 

Job  2 

Jobs 

Person  1 

8 

7 

6 

Person  2 

5 

1 

0 

Person  3 

6 

4 

1 

1 


Linear  Programming  Approach 

A  solution  to  the  personnel  assignment  problem  with  linear  programming  is  possible 
because  the  problem  involves  the  assignment  of  limited  resources  (people)  to  jobs  in  an  optimal 
manner  (Hillier  &  Lieberman,  1990).  The  example  problem  involving  3  people  and  3  jobs  shown 
on  the  previous  page  may  be  structured  as  the  linear  programming  problem: 

Let  xjj  =  a  decision  variable  associated  with  the  assignment  of  person  i  to  job  j.  (The  solution  for 
the  example  problem  will  yield:  Xjj=l  if  person  i  is  assigned  to  job  j  and  xy— 0  if  person  i  is  not 
assigned  to  job  j.) 

Using  payoff  matrix  values  as  coefficients. 

Maximize  Total  Payoff = Z  =  8x„  +  7x,2  +  6x,3  +  Sx^,  +  Ix^^  +  Ox^j  +  6X3,  +  4X33  +  1X33 


subject  to: 


^11  ^12  ^13  —  ^ 

X21  +  X22  +  X23  ^1  ^ 

X31  +X32  +X33  <1 


Xji  +X21  +X3J  >  1 

^12  ^22  ^32  —  ^ 

Xi3  +  X23  +  X33  ^  1 


Supply  Constraints  (People  supplied  must  be  less 
than  or  equal  to  the  number  of  people  who  are 
available) 

Demand  Constraints  (At  least  one  person  must  be 
assigned  to  each  job,  that  is,  the  number  of  people 
assigned  to  each  job  must  be  greater  than  or  equal  to  job 
demands) 


and 


,  JC21 .  ^31 . ^12 , ^22  > ^32 , ^13 ,  >^23 , ^33  ^  0-  This  is  a  non-negativity  constraint  which  insures  that  all 
xy  values  are  ^  0  to  facilitate  a  meaningful  linear  programming  solution. 


This  sort  of  problem  may  be  solved  using  Danzig's  simplex  method  (Wagner,  1969).  The 
solution  using  this  method  for  the  example  problem  yields  values  for  all  xy  that  maximize  the 
objective  fiinction  (Z).  These  xy  values  for  all  terms  produce  an  objective  function  Z  —  15  for  the 
example  problem. 


11  >  ^12  J  ^13  J  ^21  >  ^22  ?  ^23  ?  "^31  >  *^32  ?  ^33 


^31,  >^32  ,>^33)  =  (0,0,1,1,0,0,0,1,0) ;  Z  =  15 


Additionally,  the  simplex  method  may  be  used  to  find  values  of  xy  that  minimize  the  objective 
function  (Z)  producing  a  minimal  solution. 

More  efficient  solutions  than  Danzig’s  simplex  method  are  possible  by  using  instead  a 
transportation  simplex  algorithm  that  represents  people  as  supplies  and  jobs  as  demands  (See 
Fig  1).  Additionally,  the  transportation  representation  is  also  preferred  because  it  allows  for  the 
representation  of  jobs  with  openings  for  more  than  more  individual.  Such  a  representation  is 
preferred  since  classification  of  new  Air  Force  recruits  involves  assigning  them  to  one  of  many 
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identical  “quotas”  or  school  seats  available  for  the  same  type  of  training  course.  (Hillier  & 
Lieberman,  1990). 

Although  linear  programming  provides  "optimal"  person-job  assignments,  it  relies  on  the 
availability  of  a  batch  of  people  and  jobs  where  people  must  wait  to  be  assigned  and  jobs  must 
wait  to  be  filled.  This  batch  approach  prevents  recruiters  from  “booking"  jobs  on  a  periodic  basis 
and  prohibits  jobs  from  being  filled  as  they  become  available.  These  factors  limit  the  usefulness  of 
linear  programming  for  assigning  enlisted  personnel  to  jobs.  For  these  reasons,  the 
implementation  of  a  sequential  system  that  assigns  people  to  jobs  as  the  people  are  available 
would  be  beneficial  to  the  Air  Force. 


supplies 

(people) 


(equal  to  the  number  of  class  seats  per  job) 

Figure  1.  Example  formulation  of  transportation  problem  to  solve  the  personnel  assignment 
problem 


Development  of  the  Decision  Index 

One  of  the  first  sequential  approaches  to  the  personnel  assignment  problem  was  developed 
by  Brogden  (1946).  He  suggested  that  there  was  a  better  way  to  assign  people  to  jobs  than 
merely  assigning  an  individual  to  the  job  for  which  the  applicant  had  the  highest  test  score. 
Brogden  suggested  a  method  for  assigning  personnel  based  on  factors  besides  an  individual's  test 
scores  for  the  determination  of  proper  job  placement.  His  method  calculates  "critical  rejection 
scores"  using  distributional  information  from  historical  test  scores  as  well  as  job  demands.  Critical 
rejection  scores  are  values  that  must  be  exceeded  by  an  individual’s  test  scores  before  he/she  may 
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be  assigned  to  a  specific  job.  Assignments  made  using  critical  rejection  scores  outperformed 
simple  sequential  assignments  (Brogden,  1946). 

Dwyer  extended  the  concept  of  using  historical  "payoff'  information  with  the  method  of 
optimal  regions.  (Dwyer,  1954)  Further  refinement  of  this  concept  introducing  the  “Decision 
Index”  was  made  by  Ward  (1959). 

The  decision  index  (DI)  is  based  on  the  concept  that  in  order  to  assign  a  person  to  a  job, 
job  "payoff'  information  fi-om  other  potential  applicants  must  be  considered.  Batch  processes 
such  as  linear  programming  do  take  into  account  other  personnel  "payoffs"  when  making  an 
assignment  because  this  information  is  available.  In  a  sequential  process,  the  specific  scores  of 
other  personnel  are  not  known,  but  information  about  the  way  people  historically  score  may  be 
estimated.  This  information  can  be  used  to  make  an  assignment  which  optimizes  the  benefit  from 
all  assignments  in  contrast  to  a  simple  sequential  strategy  that  maximizes  benefits  for  a  single 
person  at  a  time.  Since  some  jobs  possess  lower  mean  payoff  values  than  other  jobs,  the  decision 
index  transforms  individual  payoff  matrix  cell  values  to  account  for  these  differences.  The 
decision  index  increases  the  payoff  of  individuals  with  high  payoffs  in  jobs  with  low  mean  payoff 
values  while  reducing  the  payoffs  of  individuals  with  low  payoffs  in  jobs  with  high  mean  payoff 
values. 


Mathematically,  there  are  various  implementations  of  the  decision  index.  The  basic  form 


for  a  cell  (i,j)  in  a  payoff  matrix  is: 

Dli  j=(Cell  payoff)  -  (job  (column)  effects)  -  (person  (row)  effects)  +  (Correction) 


or 


where: 


n(jn-X) 


(wCj,  -c,  -Cj  +c) 


(1) 


m  =  number  of  personnel  assigned 
n  =  number  of  jobs  available 
Cij=  assignment  cell  payoff 
and 


n 


;=i 

(Column  sum  of  payoffs) 

II 

^9 

(Row  sum  of  payoffs) 

m  n 

/=i 

(Grand  sum  of  payoffs) 

This  representation  of  the  DI  represents  the  mean  of  all  (n-1)!  possible  assignments  that 
could  be  made  involving  any  particular  cell  (Ward,  1959).  In  a  sequential  assignment,  where  no 
information  about  the  payoffs  of  other  individuals  is  available,  historical  means  are  substituted. 
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Similarly,  in  a  practical  implementation  of  the  decision  index  within  a  sequential  system  the  terms 
- - - ,  Ci,  and  c  may  be  removed  because  they  will  always  be  equal  for  all  row  values.  These 

simplifications  reduce  the  operational  form  of  the  DI  to; 

DIy=(c,j-Cj)  (2) 


Example  Application  of  The  Decision  Index 

The  following  example  shows  an  application  of  the  decision  index  to  sequentially  assign  a 
batch  of  3  people  to  3  jobs.  The  DI  is  not  recalculated  following  each  assignment. 

The  payoff  matrix  with  computed  row,  column,  and  matrix  sums  is: 


Sequential  assignments  fi'om  this  matrix  without  the  use  of  a  decision  index  yield  the  following 
assignments:  person  1  to  job  1;  person  2  to  job  2;  and  person  3  to  job  3.  These  sequential 
assignments  result  in  an  overall  "payofiP'  of8  +  l  +  l  =  10. 

The  computation  of  a  DI  matrix  or  “allocation  matrix”  using  the  DI  equation  (1)  yields: 


Sequential  assignments  fi'om  this  allocation  matrix  (without  DI  recalculation  following  each 
assignment)  sends  person  1  to  job  3;  person  2  to  job  1;  and  person  3  to  job  2  resulting  in  an 
overall  "payoff'  of  15.  Even  though  sequential  assignments  which  are  optimal  are  possible,  as 
was  shown  in  this  example,  this  result  is  not  typical.  Sequential  personnel  assignments  that  are 
made  using  a  decision  index  generally  yield  suboptimal  assignments  due  the  ordered  nature  of 
sequential  assignments. 
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An  example  of  the  application  of  the  decision  index  to  an  assignment  situation  without 
knowledge  of  the  historical  “payofiFs”  for  other  personnel  involves  one  person  who  may  be 
assigned  to  three  jobs. 


Jobl 

Job  2 

Jobs 

Person  1 

8 

7 

6 

A  sequential  assignment  system  without  the  decision  index  would  assign  person  1  to  job  1. 
However,  a  sequential  assignment  system  that  implements  the  decision  index  subtracts  historical 
column  average  “payoffs”  from  each  job  “payoff.” 


Jobl 

Job  2 

Jobs 

Person  1 

8-5  =  3 

7-3=4 

6-  1  0  =  -4 

If  historical  job  “payoff”  values  were  5,  3,  and  10  respectively,  person  1  would  be  assigned  to  job 
2. 

Decision  Index  Implementation 

In  order  to  apply  the  DI  to  sequential  personnel  assignments,  it  is  necessary  to  first 
calculate  average  job  payoff  values  (column  means)  from  historical  data.  These  column  means  are 
then  subtracted  from  each  individual’s  payoff  values  for  all  jobs  for  which  the  individual  qualifies. 
This  method  may  be  modified  to  find  a  sequential  solution  to  a  problem  that  can  be  solved  in  a 
batch.  If  a  batch  of  people  and  jobs  are  awaiting  sequential  assignment,  column  means  can  be 
calculated  from  this  set  to  create  an  allocation  matrix.  Jobs  are  allocated  based  upon  this  matrix. 
Recalculation  of  column  means  following  each  assignment  may  be  performed  to  further  increase 
the  total  payoff  (Ward,  1959). 

Other  variations  of  this  approach  can  be  used  to  find  sub-optimal  approximations  to  the 
transportation  problem.  The  decision  index  may  be  calculated  for  all  values  of  a  transportation 
matrix.  The  highest  of  these  DI  values  may  then  be  assigned.  Recalculation  of  the  decision  index 
following  each  assignment  improves  the  optimality  of  an  assignment  when  this  method  is  used. 
The  application  of  the  decision  index  to  a  transportation  problem  is  a  slight  variation  of  Russell’s 
method  that  subtracts  the  greatest  column  and  row  payoffs  from  a  shipping  cost  rather  than  the 
column  and  row  means  (Hillier  &  Lieberman,  1990). 

Previous  work  by  McWilliams  (1970)  compared  several  methods  for  approximating  the 
solution  of  a  transportation  problem.  The  methods  compared  included  the  cost  minima, 
northwest  comer  mle,  column  by  column  minimum,  Vogel’s,  Ward’s,  and  the  C**  methods. 
Results  showed  that,  of  these  methods,  Ward’s  and  the  C**  provided  the  closest  approximation  of 
an  optimal  result.  Furthermore,  Ward’s  decision  index  method  produced  solutions  that  captured 
approximately  96%  of  the  payoff  attained  through  optimal  methods.  These  approximations  did 
not  vary  despite  changing  matrix  sizes,  or  ratio  of  supply  variables  to  demand  variables 
(McWilliams,  1970).  McWilliams’  results  were  based  upon  recalculation  of  the  decision  index 
following  each  assignment — an  approach  which  produces  more  optimal  results  than  assigmnent 
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without  recalculation.  Also,  McWilliams’  application  of  the  decision  index  was  implemented  by 
“assigning  individuals”  in  accordance  with  the  relative  magnitude  of  their  highest  DI  payoff  value. 
This  approach  differs  from  a  sequential  assignment  strategy  that  requires  assignment  of  all 
individuals  in  a  sequential  manner.  McWilliams  was  concerned  with  finding  near-optimal 
approximations  to  transportation  problems  rather  than  assigning  individuals  in  a  sequential 
manner. 


STATEMENT  OF  THE  PROBLEM 

The  problem  addressed  by  the  current  study  concerned  the  degree  to  which  sequential 
personnel  assignments,  without  DI  recalculation  following  each  assignment,  would  approximate 
optimal  assignments  under  varying  conditions  including;  changing  batch  sizes,  person-to-job 
ratios,  personnel  rejection  rates,  and  personnel  payoff  distributions.  This  effort  did  not  allow  for 
DI  recalculation  following  each  assignment,  as  was  done  by  McWilliams,  because  this  approach 
would  be  impossible  to  implement  in  a  truly  sequential  system.  In  a  sequential  assignment  system, 
entire  payoff  matrices  never  exist  making  it  impossible  to  recalculate  DI  values  following  each 
assignment. 


METHOD 

Payoff  matrices  were  generated  for  several  experimental  conditions  (e.g.,  size,  payoff 
distributions,  etc.)  using  Monte  Carlo  techniques.  Assignments  were  then  made  from  these  payoff 
matrices  using  five  methods:  optimal  assignments,  sequential  assignments  using  a  decision  index, 
simple  sequential  assignments,  random  assignments,  and  minimal  assignments.  The  fitness  of  the 
competing  assignment  methods  was  judged  by  determining  how  well  their  payoffs  approached 
optimal  values.  This  process  was  repeated  multiple  times  for  each  set  of  conditions  in  order  to 
achieve  generalizable  results. 

Generation  of  Payoff  Matrices 

Payoff  matrices  were  generated  to  represent  the  resulting  payoff  from  assignment  of 
people  to  jobs.  Each  cell  (Cy)  of  the  matrix  represents  the  payoff  to  the  Air  Force  resulting  from 
assignment  of  person  (i)  to  job  0)-  For  the  purposes  of  this  study,  the  payoffs  were  generated  to 
be  identically  and  independently  distributed  (HD).  Since  payoffs  represent  the  intrinsic  utility  or 
worth  to  the  Air  Force  arising  from  assigning  an  individual  to  a  specific  job,  it  is  a  reasonable 
assumption  that  they  are  normally  distributed.  In  selected  cases  the  distribution  was  truncated  at 
the  40th  percentile  to  approximate  the  Air  Force  Qualifying  Test  (AFQT)  entry  standard. 

Various  sizes  of  matrices  were  generated  ranging  from  5  x  5  to  50  x  50  matrices. 
Additionally,  various  person-to-job  ratios  were  examined.  Jobs  with  multiple  openings  or  “class 
seats”  were  represented  by  the  creation  of  identical  payoffs  in  multiple  columns.  The  number  of 
identical  columns  generated  was  equal  to  the  number  of  class  seats  available  in  a  job.  The 
following  example  shows  the  difference  between  expressing  3  people  and  3  jobs  (with  one  class 
seat  per  job)  and  expressing  3  people  and  1  job  (with  three  class  seats  per  job). 
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In  cases  where  there  were  more  people  assigned  than  jobs  avmlable,  dummy  jobs  were  created  to 
allow  ^people  to  =  Xjob  seats.  This  condition  is  necessary  for  solution  of  the  transportation  problem  and 
the  assignment  problem.  (Hillier  &  Lieberman,  1990).  The  method  of  expressing  job  demands 
with  multiple  columns  and  then  applying  the  assignment  problem  is  mathematically  equivalent  to 
expressing  multiple  job  demands  in  the  transportation  problem. 


Linear  Programming  Solution  of  Assignment  Problem 

In  the  present  study,  since  jobs  possessing  multiple  class  seats  were  represented  with 
multiple  columns  rather  than  by  job  demands  exceeding  one,  this  representation  reduced  the 
transportation  problem  to  the  special  case  of  the  assignment  problem.  Assignment  problems  are 
transportation  problems  that  have  all  supply  and  demand  variables  equal  to  one  (Hillier  & 
Lieberman,  1990).  This  problem  reformulation  required  the  use  of  the  Hungarian  method  for 
finding  optimal  solutions  (Storm  Version  2.0.  1989). 


Comparison  of  Methods  Using  Range  of  Values  Metric  (p) 

In  order  to  evaluate  the  relative  performance  of  the  five  personnel  assignment  methods,  a 
metric  developed  by  McWilliams  (1970)  was  used.  This  metric  (p),  which  reflects  the  percentage 
of  optimal  solution  attained  by  a  given  method,  is  expressed  as  a  function  of  the  achieved  average 
payoff  per  person  (a)  from  a  given  assignment  algorithm;  the  optimal  average  payoff  per  person 
(o);  and  the  minimal  average  payoff  per  person  (m)  using  the  equation: 


^£_^'|*10o 

\o-mJ 


(2) 


The  metric  (p)  will  equal  100  if  an  optimal  solution  is  reached  and  will  equal  0  if  a  minimal 
solution  is  achieved.  Other  values  of  p  express  solutions  that  range  between  optimal  and  minimal. 

Since  this  metric  varies  with  the  specific  random  payoffs  that  populate  a  matiix,  multiple 
matrices  were  created  for  each  experimental  condition  to  create  a  sample  upon  which  an  expected 
value  of  p  could  be  inferred.  Also,  because  each  matrix  was  composed  of  random  variables  drawn 
from  normal  distributions,  the  overall  average  payoffs  per  person  resulting  fi-om  solutions  to  the 
matrix  were  also  normally  distributed.  The  central  limit  theorem  suggests  that  the  expected  value 
of  p  may  be  found  by  taking  the  average  of  a  sufBciently  large  sample  of  values  of  p  (Hillier  & 
Lieberman,  1990).  In  order  to  ensure  that  the  mean  of  a  sample  of  50  matrices  was  representative 
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of  the  true  population  mean,  the  confidence  interval  for  the  optimal  values  of  the  5x5  matrix  was 
determined.  The  5x5  matrix  was  used  because  it  contains  the  greatest  variation  in  its  optimal 
solutions  among  the  matrices  that  were  used  causing  its  confidence  interval  to  be  the  largest  of  all 
matrix  sizes  that  were  examined  in  the  study.  The  confidence  interval  for  the  sample  mean  of  p 
firom  a  sample  of  50  5  x  5  matrices  at  a=.01  was  within  an  acceptable  ±  .1  E(p). 

Benchmarking  Method  With  Prior  Work 

In  order  to  ensure  the  validity  of  the  payoff  generation  methods  and  assignment  algorithms 
we  compared  these  procedures  with  prior  work  by  Brogden  (1959).  He  examined  the  average 
optimal  payoff  that  could  be  achieved  for  varying  numbers  of  jobs  and  personnel  rejection  rates. 
He  used  HD  payoffs  from  a  N(0,1)  distribution. 


Experimental  Conditions 

The  ability  of  sequential  assignments  to  approximate  optimal  assignments  under  four 
experimental  conditions  was  examined.  The  first  condition  examined  was  changing  batch  size. 
Batch  size  refers  to  the  size  of  the  matrix  under  consideration.  In  a  batch  assignment  system,  this 
value  refers  to  the  number  of  personnel  that  are  assigned  in  a  group. 


Additionally,  the  impact  of  changing  person-to-joh  ratios  on  the  optimality  of  sequential 
assignments  was  investigated.  Specifically,  the  conditions  examined  were:  fixed  numbers  of 
people  and  varying  numbers  of  jobs;  and  fixed  numbers  of  jobs  and  varying  numbers  of  people. 
Values  of  E(p)  were  calculated  for  each  condition. 


Another  aspect  of  varying  person-to-job  ratios  dealt  with  examination  of  the  effect  of 
different  personnel  rejection  rates  on  the  optimality  of  sequential  assignments.  Matrices  were 
generated  with  payoff  drawn  from  N(0,1)  distributions.  These  matrices  were  populated  so  that 
there  were  more  people  than  jobs  for  each  assignment.  This  was  done  by  allocating  a  percentage 
of  the  columns  of  the  payoff  matrix  as  dummy  variables.  People  who  were  assigned  to  these 
columns  were  considered  to  have  been  “rejected.” 


Person  1 
Person  2 


Jobl 


Dunamy  job 


This  procedure  (dummy  variables)  was  acceptable  for  examining  batch  assignments  but 
not  for  sequential  assignments.  In  sequential  assignments  with  more  jobs  than  people,  people  will 
be  assigned  to  jobs  until  all  of  the  jobs  are  filled.  This  method  will  always  “reject”  the  last  people 
in  a  batch.  TMs  problem  motivated  the  development  of  “personnel  qualification  scores”  for  the 
implementation  of  sequential  assignments  with  personnel  rejection.  “Personnel  qualification 
scores”  had  to  be  exceeded  by  the  sum  of  an  individual’s  “payoffs”  before  that  individual  could  be 
assigned.  If  this  “personnel  qualification  score”  was  not  exceeded,  an  individual  was  considered 
“rejected.” 
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Personnel  qualification  scores  were  calculated  by  summing  random  variables  (C)  across 
the  rows  of  a  payoff  matrix  to  create  a  new  random  variable  (S). 

S  =  (3) 

1 

-t 

Cutoff  scores  were  then  calculated  to  reject  a  fixed  percentage  of  personnel  based  on  standard 
normal  probabilities  for  the  random  variable  S. 

Finally,  the  effect  of  changing  the  underlying  properties  of  the  distribution  fi-om  which 
payoffs  were  drawn  was  examined.  The  specific  variables  examined  included  the  standard 
deviation  and  the  truncation  point  of  the  payoff  distribution. 

RESULTS 


Benchmark  of  Methods 

The  methods  used  in  this  study  produced  results  that  were  comparable  to  Brogden’s 
results  (1959).  Using  payoffs  drawn  from  a  N  (0,1)  distribution,  increasing  numbers  of  jobs  were 
exposed  to  fixed  groups  of  people.  Results  showed  almost  identical  optimal  payoff  values  to 
those  predicted  by  Brogden  (See  Figure  2).  Similar  results  were  seen  when  the  methods  used 
were  compared  to  Brogden’s  results  for  varying  personnel  rejection  rates  (See  Figure  3). 


Figure  2.  Benchmark  with  Brogden’s  results  for  changing  numbers  of  jobs 
3t 


Expected 

Optimal 

Payoff 


•  ■■■  Results  Achieved 

— 1 — 1 — 1 — 1- 

■ . Brogden’s  Results 

0  10  2030405060  70  8090 

Percent  of  Personnel  Rejected 

Figure  3 .  Benchmark  with  Brogden’s  results  for  changing  rejection  rates 
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Batch  Size  Results 


Batch  sizes  ranging  from  5x5  to  50x50  matrices  were  examined.  Additionally,  job 
*  demands  included:  1  class  seat/  job,  5  class  seats/job,  and  10  class  seats/job.  Each  expected  value 

was  derived  from  a  samples  of  50  separate  matrices.  Each  matrix  was  populated  from  a 
truncated  normal  distribution  N(50,100).  Truncation  occurred  at  the  40%  percentile  or  at  .27 
standard  deviations  below  the  mean  to  represent  Air  Force  entry  standards.  As  expected,  larger 
payoffs  resulted  from  larger  batch  sizes  (Figure  4).  Further,  expected  p  values  resulting  from 
sequential  methods  with  and  without  the  decision  index  remained  relatively  constant  throughout 
changing  batch  sizes  (about  92%).  Additionally,  sequential  methods  using  the  decision  index 
were  only  slightly  higher  (<1%)  than  strictly  sequential  methods.  This  phenomenon  was  exhibited 
for  1  class  seat,  5  class  seat,  and  10  class  seat  jobs.  Increasing  the  batch  size  had  no  effect  on  p 
for  all  sequential  assignments  regardless  of  whether  or  not  a  decision  index  was  used. 


Figure  4.  Effect  of  varying  batch  size  on  average  payoff  per  person 

Person-Job-Ratio  Results 

The  effect  of  changing  the  person-to-job  ratio  was  examined  by  first  holding  the  number 
of  jobs  constant  and  changing  the  number  of  people  available.  Then,  the  number  of  people 
available  was  held  constant  and  the  number  of  available  jobs  was  varied.  Payoffs  were  drawn 
from  a  truncated  normal  distribution  N(50,100)  that  was  truncated  at  the  40th  percentile.  The 
number  of  available  people  ranged  from  1  to  50.  From  Figure  5,  it  can  be  seen  that  changing  the 
number  of  people  had  no  effect  on  the  overall  optimal,  minimal,  sequential(DI),  sequential,  or 
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random  expected  payoffs.  As  was  the  case  with  changing  batch  sizes,  the  expected  value  of  p 
remained  at  about  92%  throughout  changing  conditions.  Similarly,  sequential  assignments  that 
were  made  with  the  DI  were  only  slightly  better  (<1%)  than  assignments  made  without  the  DI. 


Figure  5.  Effect  of  varying  the  number  of  available  personnel  on  average  payoff  per  person 

Investigation  into  the  effect  of  varying  the  number  of  jobs  and  keeping  the  number 
personnel  constant  was  accomplished  using  similar  procedures.  The  number  of  personnel 
available  for  assignment  was  held  constant  at  50  and  the  number  of  jobs  ranged  from  1  to  50. 
Payoffs  were  drawn  from  the  normal  distribution  N(50,100)  truncated  at  the  40th  percentile. 
Results  presented  in  Figure  6  showed  an  increase  in  the  expected  payoff  as  the  number  of  jobs 
available  increased.  Additionally,  p  values  for  sequentid  (DI)  and  sequential  assignments 
remained  constant  throughout  changing  conditions. 
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Figure  6.  Effect  of  varying  the  number  of  available  jobs  on  average  payoff  per  person 

Personnel  Rejection  Results 

Investigation  into  the  effect  of  varying  personnel  rejection  rates  was  accomplished  by 
generating  10  by  10  matrices  with  varying  numbers  of  columns  designated  as  “dummy  jobs.”  For 
example,  a  10%  rejection  rate  designated  one  column  as  a  “dummy  job.”  Next,  the  distributions 
from  which  personnel  payoff  values  were  generated,  N(0,1),  were  summed  to  formulate  a  random 
variable  representing  the  sum  of  the  personnel  payoff  scores.  Rejection  or  qualification  scores 
were  calculated  based  upon  normal  standard  probabilities.  For  example,  the  qualification  score  (r) 
in  a  10%  rejection  situation  with  10  people  and  nine  jobs  would  equal  a  value  of  r  such  that: 

y"c 

P{^<r)^X 

This  value  of  r  would  be  computed  by  first  summing  the  payoff  distributions  across  available  jobs 
to  calculate  S  (0,9).  This  value  of  S  would  then  be  standardized  and  normal  probability  tables 
would  be  used  to  determine  a  value  of  r  that  rejects  10%  of  all  applicants. 

Results  fi-om  the  rejection  of  varying  percentages  of  personnel  as  shown  in  Figure  7  were 
similar  to  previous  results.  Payoffs  for  sequential  assignments  with  the  decision  index  were 
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Figure  7.  Effect  of  varying  batch  size  on  average  payoff  per  person 


Payoff  Distribution  Results 

The  final  area  of  investigation  involved  the  effect  of  varying  personnel  payoff  distributions 
on  the  utility  of  sequential  assignments.  The  first  parameter  changed  was  the  variation  of  the 
payoffs.  For  a  fixed  sample  of  10  people  and  10  jobs  the  standard  deviation  of  the  distribution 
fi-om  which  the  matrices  were  generated  varied  from  0  to  30  {N(50,0)=>N(50,900)}.  Expected 
payoff  values  (Figure  7.)  for  optimal  and  sequential  assignments  showed  a  linear  increase  as 
payoff  distribution  was  enlarged.  Sequential  assignments  continued  to  achieve  p  values  of 
approximately  92. 

The  effect  of  changing  the  truncation  of  personnel  payoff  distributions  was  examined  by 
using  10  people  and  10  jobs.  Payoffs  were  drawn  fi-om  a  normal  distribution  N(50,100)  with 
truncations  that  ranged  from  no  truncation  to  truncation  at  the  90th  percentile.  Results  showed 
increased  average  payoffs  per  person  with  higher  truncations  as  indicated  in  Figure  8.  Sequential 
assignment  p  values  remained  constant  throughout  the  truncation  range. 
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Figure  8.  Effect  of  varying  payoff  variation  on  average  payoff  per  person 
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Figure  9.  Effect  of  varying  the  truncation  of  the  payoff  distribution  on  average  payoff 
per  person 
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CONCLUSION 


Throughout  changing  conditions  (batch  size,  person-to-job  ratios,  personnel  rejection 
rates,  and  personnel  payoff  distributions),  sequential  assignments  achieved  a  constant  percentage 
of  the  average  payoff  per  person  compared  to  those  attained  through  optimal  assignments.  On  a 
linear  scale  that  labels  the  minimal  expected  assignment  value  as  0  and  the  optimal  expected 
assignment  value  as  100,  sequential  assignments  achieved  an  expected  value  of  92%.  This  value 
is  slightly  higher(<  1%)  for  those  assignments  that  were  achieved  using  a  decision  index  (without 
DI  recalculation  following  each  assignment).  The  slight  differences  between  these  sequential 
assignment  methods  can  be  attributed  to  the  lack  of  different  colunm  means  in  the  payoff  matrix. 
The  DD  payoffs  created  matrices  with  column  means  that  were  nearly  identical  rendering  the  DI 
almost  indistinguishable  from  the  “highest  payoff’  decision  rule.  The  slight  column  differences 
that  did  exist  explain  the  slight  amount  that  Dl-assisted  assignments  exceeded  those  made  without 
the  DI.  Future  work  should  evaluate  the  performance  of  decision  index  sequential  assignments 
with  varying  column  means  in  the  payoff  matrix  (Grobman,  In  Progress). 

Although  the  expected  values  of  92%  were  lower  than  McWilliams’  (1970)  value  of  96%, 
these  differences  are  explainable.  First,  McWilliams  applied  the  decision  index  by  assigning  the 
“person-job  match”  with  the  highest  DI  value  first.  Our  methods  assigned  the  first  individual 
before  all  others  regardless  of  his  relative  DI  value.  Additionally,  McWilliams  allowed  for  DI 
recalculation  following  each  “assignment”  whereas  we  favored  the  more  conservative  application 
with  no  recalculation.  Both  of  these  differences  in  methods  may  explain  the  differences  between 
McWilliams  and  the  present  results. 

Results  from  the  study  also  show  that  even  though  the  DI  achieved  a  relatively  constant 
92%  of  the  total  possible  benefits,  the  absolute  levels  of  the  total  benefits  varied  dramatically  with 
some  of  the  study  conditions  (i.e.,  batch  size,  personnel  rejection  rates,  and  initial  level  of 
truncation).  This  could  have  important  implications  for  Air  Force  classification,  and  assignment 
policies.  For  example,  increasing  batch  size  raises  the  overall  benefits  possible  from  assignment  as 
would  raising  entry  standards,  and  increasing  the  number  of  jobs  available  for  fill. 

Future  work  should  investigate  the  difference  in  performance  between  sequential 
assignments  made  with  the  DI  and  those  without  the  DI  under  conditions  involving  different  row 
and  column  means  in  the  payoff  matrix.  We  think  that  these  conditions  should  cause  the  DI  to 
outperform  strictly  sequential  assignments  by  a  significant  amount.  Another  area  for  future  work 
is  in  the  area  of  stochastic  programming  (Wagner,  1969).  Stochastic  programming  involves 
adding  random  variables  to  linear  programming  problems  to  achieve  expected  outcomes.  These 
methods  may  produce  analytic  solutions,  in  lieu  of  the  Monte  Carlo  approach,  to  the  types  of 
theoretical  research  questions  examined  in  this  study.  These  methods  may  surpass  Monte  Carlo 
methods  with  respect  to  their  generalizability  and  computational  efficiency. 
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